Improving the Reliability of Clinical Practice Guideline Appraisals: Effects of the Korean AGREE II Scoring Guide
نویسندگان
چکیده
The Korean translated Appraisal of Guidelines for Research and Evaluation II (Korean AGREE II) instrument was distributed into Korean medical societies in 2011. However, inter-rater disagreement issues still exist. The Korean AGREE II scoring guide was therefore developed to reduce inter-rater differences. This study examines the effects of the Korean AGREE II scoring guide to reduce inter-rater differences. Appraisers were randomly assigned to two groups (Scoring Guide group and Non-Scoring Guide group). The Korean AGREE II instrument was provided to both groups. However, the scoring guide was offered to Scoring Guide group only. Total 14 appraisers were participated and each guideline was assessed by 8 appraisers. To evaluate the reliability of the Korean AGREE II scoring guide, correlation of scores among appraisers and domain-specific intra-class correlation (ICC) were compared. Most scores of two groups were comparable. Scoring Guide group showed higher reliability at all guidelines. They showed higher correlation among appraisers and higher ICC values at almost all domains. The scoring guide reduces the inter-rater disagreement and improves the overall reliability of the Korean-AGREE II instrument.
منابع مشابه
Developing a Scoring Guide for the Appraisal of Guidelines for Research and Evaluation II Instrument in Korea: A Modified Delphi Consensus Process
Korea has a relatively short history in the development and use of clinical practice guidelines (CPGs). Additionally, it has been difficult to employ the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument due to the lack of consensus and the presence of differences in Korean medical settings and in the Korean socio-cultural environment. An AGREE II scoring guide was there...
متن کاملClinical guideline for prevention and control of alcohol consumption
Background: Using alcohol is one of the most important death factors that can be prevented. Lifestyle-related diseases are at the top cause of mortality and burden of disease, whereas most of them can be prevented. Considering the growing importance of diseases related to lifestyle (including alcohol abuse), providing evidence-based clinical guidelines for diseases and life-style related condit...
متن کاملتدوین راهنمای بالینی فرآیند تزریق خون در کودکان مبتلا به تالاسمی ماژور
Background & Aim: The &beta-Thalassemia major is a chronic disease that needs a regular blood transfusion. The blood transfusion is a complex process with high probability of human errors during the process which results in serious adverse events in patients. Nurses should deliver care based on the best available evidence or best practice. The aim of this study was to develop an evidence-base...
متن کاملClinical guideline of neurosurgical practice during the COVID-19 pandemic
Background: Neurosurgery practice conflicts with many challenges during the COVID-19 pandemic; Including the lack of beds in intensive care units, as well as the use of some methods such as drills and trans-nasal and trans-oral approaches that produce aerosols or are directly in contact with patient discharge. Due to these challenges, developing a clinical guideline to help neurosurgeons and me...
متن کاملEfficient clinical evaluation of guideline quality: development and testing of a new tool
BACKGROUND Evaluating the methodological quality of clinical practice guidelines is essential before deciding which ones which could best inform policy or practice. One current method of evaluating clinical guideline quality is the research-focused AGREE II instrument. This uses 23 questions scored 1-7, arranged in six domains, which requires at least two independent testers, and uses a formula...
متن کامل